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Abstract 

We derive formulas on the probability-generating functions for many partic- 
ipants of the Penney's game and generalize the Conway's formula on this case. 
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i — i ! 1 Introduction 

Let us toss an 'unfair' coin with probabilities p for heads and q = 1 — p for tails and 
wait for an appearance of some chosen string of heads and tails. What is the expected 
number of tosses until this string occurs? 

We recall the solution obtained by Solov'ev in [5], introducing by the way needed 
notations and presenting a model reasoning. Let A be some string of heads and tails 
of length I. Let A n denote the set of sequences in which the string A appears exactly 
^T) . in the n-th toss and p n the probability of A n \ p n = P(A n ). Let B n denote a set 

of sequences in which A does not appear in the first n tosses and its probability by 
[ q n = P(B n ). Let us consider now a set of sequences in which in the first n tosses A 

1 does not appear and in the next I attempts it appears. It seems that the probability 

of this set amounts to q n P(A) is equal to p n+ i but we must check whether A does not 
occur earlier in the attempts from n + l to n + l — 1. 

Let A(fc) and AW denote strings of fc-first and fc-last terms of A (1 < k < I), 
respectively. Note that A {1) = A® = A. Let [A {k) = A^] equals 1 if A {k) = A^ or 
if not. Additionally let us assume that P(A^) = 1. Now we can write the formula on 
. c ?.' q n P{ A) as follows 

i 

q n P(A) = J2[A ik) = A^]P(A^)p n+k . (1) 

k=l 



(N 
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Observe that the Z-th summand in the above is equal to p n +i- Multiplying the above 
equation by s n+l and adding from n = to infinity we get 

i 

Qx(s)P(A)s l = g x (s) = A^}P(A^)s l ~\ (2) 

k=l 

where gx(s) = Yl^=oPnS n is the probability-generating function for a random variable 
X of number of tosses until A occurs and Qx(s) = Yl^=o ( lnS n its tail generating 
function. Since q n = YlT=n+iPk one can obtain the second equation that relates gx 
and Q x : 

Qx{s) = 1 _ s ■ (3) 
Solving the above two equations we obtain that 

P{A)s l 



9x{s) 



and 



p(a)s i + (i-s) ELMw = A(*>]p(A('-*>y 



f — i I — 1 ■ I / I — I ' I .* ' ' 

Qx(s 



P(A)s l + (l-s) ELMw = AW]P(A«-k))s l - 



k 



Since EX = Q x (l) one can calculate the general formula for the expected number of 
tosses 

FY Y!k=AA { k) = A^]P(A^) ' [^ (fc) = AW] 

It is the answer on the put at the beginning question. 

In the classical Penney Ante game (see jl] ) for a given string of fix length we want to 
show second one of the same length with a higher probability of occurring first. Guibas 
and Odlyzko in [2] proved that it is always possible and presented some optimal strategy 
for second player. The Conway's formula (see [1]) allows us to compare probability of 
winnings for each of two players. 

In this paper we derive formulas on the probability-generating functions for many 
participants of the Penney's game and generalize the Conway's formula on this case. 



2 Probability-generating functions of players 

Let m players choose m strings Ai (1 < i < m) of heads and tails of lengths U, 
respectively. We start to toss an 'unfair' coin and wait for an occurrence of some Ai. 
We ask about chances of the winning for each players that is about the probability 
PAi that the string A\ occurs as the first of others. We assume that any A^ is not a 
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substring of other Aj in an opposite case pa = or for some sequences both players 
may be win simultaneously. 

Let X denote the number of tosses to the end of the game. Notice that P(X = n) = 
p n = Y^iLiPni w here p^ is the probability that the z-th player wins exactly in the 
n-th toss. Let gx and g x * denote the probability-generating functions of distributions 
(p n ) and (p„ ), respectively, and Qx the generating function for tails distribution. 

Let B n be the set of sequences of tails and heads in which any string A^ does not 
appear in first n tosses. In the system of m patterns if we add to the set B n the string 
Ai then we must check if neither it nor other ones appear earlier. For this reason to 
the equation (JTJ) corresponds the systems of ones 

m mivL{li,lj} 

q n P(A i ) = J2 E WW = Af }P(A?> -%% h1 

3=1 k=l 

for each 1 < % < m, where [A^ = Aj] = 1 if A^ = Aj or if not. 

Multiplying the above equation by s n+li and adding from n = to infinity we get 
the following recurrence equations 

m mia{k,lj} 

Qx{s)P{A i )s^ = £ [A m = Af]P{At k ^- k . 

3=1 k=l 

Let w^(s) denote the polynomial ^^^'^[A(fc) = A^]P(Af i ~ k ^)s li ~ k . Now we can 
rewrite the above system of m equations as follows 

m 

Qx(s)P(A t )s^ = J29x(s)wil(s) (l<i<m). (4) 



3=1 



Since g x = YJj=i 9x > b y © we S et 



Qx{s) 



Substituting the above into (TjJ we obtain 

m 

W = Y,9x 3 (s)[P{A^ + (1 - s)w%{s)] (l<i< 



m) 



To solve this system of functional equations we use the Cramer's rule. Define now a 
functional matrices 
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A(s)= P(Ai)s h + (1 - s)w%(s 

and 

R(c\ — L, 



B(s)= w %(s) (5) 

l<i,3<m 



Notice that because w^(0) = 1 and 1(^(0) = for i ^ j then .4.(0) and B(0) are the 
identity matrices. Let B^(s) denote the matrix formed by replacing the j-th column 
of B(s) by the column vector [P(Ai)s li ]i<i< m . Because the determinant of matrices 
m x m is a m-linear functional with respect to columns (equivalently to rows) then one 
can check that 

in 

det A{s) = (1 - s) m det B(s) + (l-s)^ 1 J^ det #(s). 

3=1 

The determinant det.4(s) is a polynomial of variable s and det 4.(0) = 1. For these 
reasons det A(s) on some neighborhood of zero. It means that on this neighborhood 
there exist solution of the system. 

If now similarly A>(s) denotes the matrix formed by replacing the j-th column of 
A(s) by the column vector [P (Ai) s li ]i<i< m then the determinant's calculus gives that 
det A*(s) = (1 — s) m_1 det &{s). Finally by the Cramer's rule we obtain 

A x det A l {s) detB l {s) 



det A(s) E7=i det B?'(«) + i 1 ~ s ) det B ( s ) 
for 1 < i < m. In this way we proved the following 

Theorem 2.1. If m players chose m strings of heads and tails Ai (1 < i < m) such 
that any Ai is not a substring of other Aj then the probability-generating function g x * 
of winning of the i-th player is given by the following formula 

Ai/ \ _ det B l (s) 

9x ,{S) = Er=idet^( S ) + (l- S ) detB(s)' ( j 

where B(s) is the matrix defined by |3]). 

Notice that the probability-generating function g x l (s) = Y^=oPn lsn i s wen define 
on the interval [—1,1] for sure (it is an analytic function on (—1,1)). The right hand 
side of (E]) is a rational function equal to g x * on some neighborhood of zero. By the 
analytic extension we know that there exists the limit of the right hand side of (E]) by 
s — > 1~ which is equal to g x (1)- Thus the probability pa 1 that the string Ai occurs 
first is given by the following formula 

A _ det 

" E7=idet^(l)' (7) 
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where the right hand side of the above equality we understand as the limit of (jSJ) by 
s -> 1". 

Define a number Aj : Aj as 



„A/i\ min{ii,J 3 -} 



A 



(AO 



P{A 



fc=l 



For the fair coin {p = q 



min{£;,£j} 

E 

k=l 



[A 



i(k) 



A 



P(A 



Aj '. Ai 



k=X 



A^ 



and it coincides (up to the scalar 2) with the notation introduced in [3]. 

Define now a matrix C = [{Aj : AA] x< . , <m . Observe that det B{1) = H™ =1 P{Ai) det C 
and det 23 J ( 1 ) = YHLj det C- 7 , where C J is the matrix formed by replacing the j-th 

column of C by the column vector [l] . By (J7J) and the above observations we can 
formulate the following 

Corollary 2.2. TTie probability that the i-th player wins is equal to 

dete 



E7 =1 det^' 



Let us emphasize that the above corollary is the generalization of the Conway's 
formula. For two players we get 



Pa 1 det C 1 
Pa 2 det C 2 



det 



1 {A 2 :A 1 ) 
1 (A 2 :A 2 ) 



: det 



'{Ax: At) 1 
{A\ : A 2 ) 1 



{A 2 : A 2 ) - (Ag : Aj) 
{Aj : Ax) - {Aj : A 2 ) 



Example 2.3. Take three strings of heads (H) and tails (T): Ai = {THH), A 2 
{HTH) and A 3 = {HHT). In this case 



1<«,J<3 



1 

pqs 2 



1 2" 

p S 

pqs 2 + 1 



pqs 2 + qs pqs 2 1 



By Theorem 12.11 one can obtain the probability-generating functions for winnings of 
i-th player. The matrix 



C 



- 1 l<ij'<3 



1 


J_ 


1 


p 2 q 
1 


pq 
pq+l 


? 

J_ 


P- 
p+l 

p 2 


p 2 q 
1 

P 


1 

P 2 <? 
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By Corollary 12.21 we can calculate the probability that the z-th player wins: 



PA 




q(l+pq) 



l + q 



PA 3 



pi} - q 2 ) 

l + q 



For the fair coin pa 1 



l 

■i - 



Remark 2.4. Notice that the above results are true not only for binary strings but 
also for strings that take many values. 
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